Management of Real-Time Streaming Data Grid Services
نویسندگان
چکیده
We discuss the architectural and management support of real time data streams, both in terms of lower level messaging and higher level service, filter and session structure. Our messaging system acts as a substrate that can be used to provide qualities of service to various streaming applications ranging from audio-video collaboration systems to sensor grids. The messaging substrates are composed of distributed, hierarchically arranged message broker networks. We discuss the role of management systems for both broker networks and filters: broker network topologies must be created and maintained, and distributed filters must be arranged in appropriate sequences. These managed broker networks may be applied to a wide range of problems. We discuss applications to audio/video collaboration in some detail and also describe applications to streaming Global Positioning System data streams. These provide specific application filters that can transform and republish message streams to
منابع مشابه
Grids for Real Time Data Applications
We describe our work in building support for streaming data services for Geographical Information System Grid services. We examine how streaming approaches may be used to increase data service performance for transporting XML messages. Similarly, streaming versions of traditional static map services may be combined with general audio/video session management capabilities to build collaborative,...
متن کاملDesign and Test of the Real-time Text mining dashboard for Twitter
One of today's major research trends in the field of information systems is the discovery of implicit knowledge hidden in dataset that is currently being produced at high speed, large volumes and with a wide variety of formats. Data with such features is called big data. Extracting, processing, and visualizing the huge amount of data, today has become one of the concerns of data science scholar...
متن کاملGrid Resource Management and Scheduling for Data Streaming Applications 1001 GRID RESOURCE MANAGEMENT AND SCHEDULING FOR DATA STREAMING APPLICATIONS
Data streaming applications bring new challenges to resource management and scheduling for grid computing. Since real-time data streaming is required as data processing is going on, integrated grid resource management becomes essential among processing, storage and networking resources. Traditional scheduling approaches may not be sufficient for such applications, since usually only one aspect ...
متن کاملThe Solid Earth Research Virtual Observatory: Web Services for Managing Geophysical Data and Applications
We describe our distributed systems research efforts to build the “cyberinfrastructure” components that constitute a geophysical Grid, or more accurately, a Grid of Grids. Service-oriented computing principles are used to build a distributed infrastructure of Web accessible components for accessing data and scientific applications. Our data services fall into two major categories: archival, dat...
متن کاملGrid Resource Management and Scheduling for Data Streaming Applications
Data streaming applications bring new challenges to resource management and scheduling for grid computing. Since real-time data streaming is required as data processing is going on, integrated grid resource management becomes essential among processing, storage and networking resources. Traditional scheduling approaches may not be sufficient for such applications, since usually only one aspect ...
متن کاملManagement of Data Streams for a Real Time Flood Simulation
We examine the challenge of coupling applications to real-time data sources in a Grid environment. Such problems are important to the emerging field of Grid-based emergency planning and crisis response, in which realtime data sources must be coupled to modeling applications to provide timely forecasting to emergency planners and responders. In this paper we present a Grid-based scripting workfl...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- Concurrency and Computation: Practice and Experience
دوره 19 شماره
صفحات -
تاریخ انتشار 2005